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DETAILED ACTION 

Specification 

1 . This application does not contain an abstract of the disclosure as required by 37 
CFR 1.72(b). An abstract on a separate sheet is required. 

Claim Rejections - 35 USC § 102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in a patent granted on an application for patent by another filed in the United 
States before the invention thereof by the applicant for patent, or on an international application by another who 
has fulfilled the requirements of paragraphs (1), (2), and (4) of section 371(c) of this title before the invention 
thereof by the applicant for patent. 

3. Claims 1-7, are rejected under 35 U.S.C. 102(e) as being anticipated 
by Rhoads et al (U.S. patent 7,050,603). 

Regarding claim 1, Rhoads discloses a method of detecting a watermark in a multimedia 
signal being rendered by an application executed by a computer system in a window of a display 
screen connectable to said computer system, said window covering a part of the image area of 
said display screen (column 5, lines 39-53, on the end user side, there are two places for network 
connectivity, rendering of linked information, and user interaction. Internet connectivity can be 
included in the video display device or associated set-top box or in a portable display device, 
such as a personal laptop. The rendering of the linked information can occur on the video 
display, possibly using picture-in-picture technology so others can still see the original video, or 
in the portable display device, such as a laptop since Internet browsing can be a personal 
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experience. User interaction with the system, such as selecting the object to find linked 
information can happen with the video display, such as pointing with a remote, or with a portable 
display device, such as using a mouse on a laptop. Specific implementations can include a 
variety of combination of these components); 

the method comprising the steps of examining the video signal being generated by said 
computer system and applied to said display screen to locate image areas in which the video 
signal changes from frame to frame (column 6, lines 15-21, in other words, a process at the end- 
user side maps the location of the user selection to an identifier based on the locations encoded 
along with the identifiers in the content. For example, a segment of the audio track that is 
intended to be played with a corresponding video "frame to frame" sequence may include a 
watermark or watermarks that carry one or more pairs of identifier and locations); 

defining a bounding box around said image areas to provide an area of interest (column 6, 
lines 25-26, a modification includes providing bounding locations in the watermark); 

and detecting the watermark in said area of interest ( column 6, lines 26-29, determining 
whether the user's selection is within this area, as opposed to using the closest watermark 
location to the user's selection). 

Regarding claim 2, Rhoads discloses a method as claimed in claim 1, wherein said 
bounding box is rectangular (see claim 1, also column 10, lines 1-2, the screen extents may be as 
coarse as a bounding rectangle or a polygonal shape entered by drawing a boundary around an 
object via a video editing tool). 

Regarding claim 3, Rhoads discloses a method as claimed in claim 2, in which the 
watermark detector is arranged to detect the watermark in a image having a predetermined 
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resolution, the method further comprising the step of scaling the area of interest to said 
predetermined resolution (column 1 1, lines 32-45, a more efficient approach is to implement a 
watermark screen that invokes a watermark decoder only when watermark data is likely to be 
present. A control signal sent in or with the video content can be used to invoke a watermark 
decoder. The control signal may be an in-band signal embedded in the video content, such as a 
video or audio watermark. For example, a watermark detector may look for the presence of a 
watermark, and when detected, initiate a process of decoding a watermark payload, accessing 
information or actions linked via an object identifier in the payload, and displaying the linked 
information or actions to the user. The control signal may be one or.more control bits in a 
watermark payload decoded from a watermark signal, also column 13, and lines 47-49, the 
location code is specified at a reference frame resolution, and the user selection coordinates are 
normalized to this reference resolution). 

Regarding claim 4, Rhoads discloses a method as claimed in claim 1, further comprising 
the steps of examining the video signal for further areas of interest, and detecting the watermark 
in said further areas of interest (column 12, lines 8-17, the decoding process may focus a 
watermark decoding operation on a spatial region around a screen location of a video display 
selected by the user. Alternatively, the user might issue a command to look for enabled content, 
and the decoding process would initiate a watermark detector on frames of video or audio 
content in temporal proximity to the time of the user's request. The decoding process may buffer 
frames of the most recently received or played audio or video for the purpose of watermark 
screening in response to such requests). 
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Regarding claim 5, Rhoads discloses a computer system arranged to execute an 
application which renders a possibly watermarked multimedia signal in a window of a display 
screen connectable to said computer system, smd window covering a part of the image area of 
said display screen, the computer system comprising (column 12, lines 19-25, one configuration 
is video player with an interactive user interface that displays video content and implements 
watermark enabled features. In this configuration, the player decodes the watermark, displays 
video content, and enables the user to select video objects via its interactive user interface. The 
player may have a local database for looking up the related information or action of an identifier 
extracted from a video object); 

means for examining the video signal being generated by said computer system and 
applied to said display screen to locate image areas in which the video signal changes from frame 
to frame; means for defining a bounding box around said image areas to provide an area of 
interest; and a watermark detector for detecting the watermark in said area of interest (column 
12, line 60 through column 13, line 8, the local processing system renders the video content 810. 
In a PC, the rendering process includes converting the video signal to a format compatible with 
the video controller in the computer and writing the video to video memory in the video 
controller 812. The video controller 812 then displays the video signal on a display device 814. 
As the video is being rendered, the local processing system buffers frames (816) of audio or 
video for watermark detecting and decoding. In a PC, the buffering may be integrated with 
rendering the video to video memory or may be implemented as a separate process (e.g., 
allocating separate video buffers in main memory or video memory). Also, depending on the 
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nature of the video signal and encoding process, the buffer may store frames of compressed 
video content or decompressed video content from which watermarks are detected and decoded). 

Regarding claim 6, Rhoads discloses a graphics card for use in a computer system 
arranged to execute an application which renders a possibly watermarked multimedia signal in a 
window on a display screen connectable to said graphics card, said window covering a part of 
the image area of said display screen, the graphics card comprising: means for examining the 
video signal being generated by said computer system and apphed to said display screen to 
locate image areas in which the video signal changes from frame to frame; means for defining a 
bounding box around said image areas to provide an area of interest; and a watermark detector 
for detecting the watermark in said area of interest (FIG. 1 A, step 104, column 4, lines 8-30, is a 
flow diagram depicting a process for encoding and decoding watermarks in content to convey 
auxiliary information 100 about video objects in the content. An embedding process 102 encodes 
the auxiliary information into a watermark embedded in the video content. A transmitter 104 
then distributes the content to viewers, via broadcast, electronic file download over a network, 
streaming delivery over a network. A receiver 106 captures the video content and places it in a 
format from which a watermark decoder 108 extracts the auxiliary information. A display 1 10 
displays the video to a viewer. As the video is being displayed, a user interface 1 14 executes and 
provides visual, audio, or audio-visual information to the user indicating that the video is 
embedded with auxiliary information or actions. This user interface may be implemented by 
superimposing graphical information over the video on the display 110. Alternatively, the 
decoder can pass auxiliary object information to a separate device, which in turn, executes a user 
interface. In either case, the user interface receives input from the user, selecting a video object. 
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In response, it performs an action associated with the selected object using the auxiliary object 
information decoded from the watermark). 

With regard to claim 7, the arguments analogous to those presented above for claims 1 
and 6 are respectively applicable to claim 7. 

Other prior art cited 

4. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

(U.S. patent 7,239,747) to Bresler et al is cited for method and system for locating 
position in printed texts and delivering multimedia information. 

(U.S. patent 6,41 1,725) to Rhoads is cited for watermark enabled video objects. 
(U.S. patent 4,628,362) to Waehner is cited for combined video AGC and digitizing 

circuit. 

(U.S. patent 3,665,162) to Yamamoto et al is cited for identification system. 

Contact Information 

5. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Seyed Azarian whose telephone number is (571) 272-7443, The 
examiner can normally be reached on Monday through Thursday from 6:00 a.m. to 7:30 p.m. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Matthew Bella, can be reached at (571) 272-7778. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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